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Abstract 

In this paper, we consider the (L, 1) state-dependent reflecting random walk 
(RW) on the half line, which is a RW allowing jumps to the left at a maxial 
size L. For this model, we provide an explicit criterion for (positive) recurrence 
and an explicit expression for the stationary distribution. As an application, we 
prove the geometric tail asymptotic behavior of the stationary distribution under 
certain conditions. The main tool employed in the paper is the intrinsic branching 
structure within the (L, l)-random walk. 
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1 Introduction and main results 
1.1 The background and motivation 

We consider the (L, l)-reflecting random walk on the half line, i.e., a Markov chain {X n } n >o on 
Z + = {0, 1,2,...} with Xq = and the transition probabilities Pij specified by : Poi = p(0) = 1; 
for < i < L, 



P 



p(i), for j = i + 1, 

qi-j(i), for0<j<2, 

Efe=i%W, forj = 0, 

0, otherwise, 
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and for i > L, 



for j 
for i 



= t + l, 
L<j<i, 



0, 



otherwise, 



where +£/ 2 (i)H r-gifaO+K*) = 1, and qi(i), (feW, • • • ,<?l(z) > 0> < p(0 < 1- Obviously, 

this Markov chain is irreducible. 

For example, when L = 2, the transition matrix P is given by 





?l(l) + 92(l) 
92(2) 



1 



qi (2) 

92(3) 





?i(3) 



p(2) 




p(3) 



V 



/ 



in which all unspecified entries are zero. 

It is well-known that for the (1, 1)-RW, the criteria for the (positive) recurrence and the 
expression for the stationary distribution have been given explicitly, for example see [8] and [9]). 
However, for L > 1, no such explicit expressions are found to our best knowledge. The aim of the 
present paper is to give explicit criteria of the (positive) recurrence and explicit expressions of 
the stationary distribution for the (L, 1)-RW. Our method is probabilistic by using the intrinsic 
branching structures hidden in the (L, 1)-RW ([5] and [6]). The results obtained in this paper 
can be applied to various state-dependent queueing systems. 



1.2 Main results 

First, we recall two results on the (positive) recurrence and the stationary distribution of a 
general Markov chain X n (e.g., [9] or [3]). For this purpose, let N(i) = J2^Li ^{x n =i} be the 
number of visits to state i by the chain, Tj = inf{n > : X n = i} is the first time for the chain 
to be in state i, and E % is the expected value when the walk starts at Xq = i. 

Fact 1 {X n } n >Q is recurrent <^=^ E°N(0) = oo <^=^ Yl'jLo PijVj = Ui {i> 0) have no bounded 
nonconstant solution; and 

Fact 2 {X n } n >Q is positive recurrent <^=^ E°Tq < oo. In this case, the stationary distribution 
n(i) is given by 7r(i) = -g^r. 

The idea of the present paper is to express E°N(0) and E l Ti explicitly through using the intrinsic 
branching structure hidden in the (L, 1)-RW. 

Three results are obtained: the first one is a characterization for recurrence; the second is 
an expression for the stationary probability distribution; and the last one is a criterion for the 
stationary probabilities to have a geometric decay. For the first two results, we present them for 
L = 2 since the notation for a general L is very demanding. The last result is presented for a 
general L. 
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1.2.1 Criteria for the recurrence 
Let e\ = (1,0), e 2 = (0, 1), u = e[ + e' 2 , the sum of the transposes of e± and e 2 , 

( gl(l)+92(l) n \ / 9lW £200 \ 

Theorem 1.1. Lei 

oo 

K :=J2 e i M kM k - 1 ...M l u, 
k=l 

if k = oo, then the walk {X n } n >o is recurrence. 

Remark Actually, k in the theorem is the expectation number of the visiting times by the 
random walk at position 0, i.e., n = E°N(0) , which can be calculated by the means of the 
intrinsic branching structure within the walk and the M, is the offspring mean matrix. 



1.2.2 Criteria for the positive recurrence and stationary distribution 

Next, we will give the criteria for the positive recurrence and explicit formula of the stationary 
distribution based on the Fact 2. Let P l denote the probability when the walk start at Xq = i. 
Define 

r = 0, Ti = inf{n > : X n < i}, i>l (1.1) 

Theorem 1.2. Assume E 1 ^ < oo, then the walk {X n } n >o is positive recurrence. Furthermore 
the stationary distribution is given by, for i > 0, 

i 1 

7T(t) 



EfiTi p(i)E i + 1 T i+1 + ( qi (i) +q 2 ii) +p(i)P i+1 [{i + l,+oo),i - l])^ 1 !} + q 2 (i)E i ~' i T i ^ + 1 

where explicit expressions for P' L+1 [{i + 1, +oo), i — 1], £7Vj and E l T i+ i are given in \2. 6 2\) , \2.4\ ) 
and \2. respectively. 



1.2.3 Tail behavior of the stationary distribution 

It is well know that when the transition probabilities are state-independent, the tail of the 
stationary distribution of the walk has a geometric decay. Here with the help of the explicit 
expression of the stationary distribution in given in the previous theorem, we can consider the 
tail behavior for the state-dependent case. We notice that the expression of the stationary 
distribution in Theorem 11.21 is given in terms of the decomposition of the trajectory, from which 
we find out that the dominant contribution to the tail asymptotic behavior of ir(i) is from 
E % ~ l Ti ( because of E t\ < oo). With this observation, characterize the tail behavior of the 
state-dependent (L, 1)-RW as follows. 
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Let D := {(p, q 1} q 2 , ■ ■ ■ q L ) ■ P + Y.j=iQj = 1; Y,j=iJ<lj > P\ v ^ ?j > °,P > °}- P( M ) is 
the spectral radius of M, and Am is the maximum eigenvalue of it, where 



/3k 21 

r> r) 



M 



ilk 

v 

1 + 21 



2a 
v 

92 



V 



21 
p 



22 

p 

'/2 



<?L-1 

P 
<?L-1 



P 1 

P 



1 + 



p 



P 



(1.2) 



LxL 



Theorem 1.3. (1) If P £ D, we have \ M = p{M) > 1. 

fi?) If P(i) := (p(i), 92(*)) " " P, as i ^ oo, and P £ D, then the stationary 

distribution exist; and 

logvr(i) 



lim 

i— >oo 



log Am- 



Remark Here D is the positive recurrence district for the state-independent (L, 1)-RW, and 
M is the correspond offspring mean matrix. The theorem says that if the transition probability 
of the state-dependent (L, 1)-RW goes to a point in D as the state goes to infinite then the walk 
is positive recurrent and the tail of the stationary distribution is geometric decay. 

1.3 Examples 

Three special cases are provided here as examples. 



1.3.1 Degenerate to the case of (1,1) state- dependent RW 

The (1, 1)-RW is the special case in which qj(i) = for j > 1. We denote qi(i) by q(i). In this 
case, p(i),q(i) > 0. Let 



Mo = 1, Mi 



p(0)p(l)---p(i-l) 
q(l)q(2)...q(i) 



for i > 0, fj, = /Xj. 

i=o 



Then, Theorem 11.11 and Theorem 1 1 . 2 1 lead to the following corollaries, which are known literature 
results (e.g. [2] and [U]). 



Corollary 1.1. The chain is recurrent iff X^So 



oo 1 



oo. 



Corollary 1.2. The stationary distribution exists iff fj, < oo. In this case, 7Tj = Mi/M- 

For the (1, 1)-RW, the tail of the stationary distribution has a very simple form as follows. 
Corollary 1.3. If p(i) — > p as i — > oo, and p < \, then the stationary distribution exists and 



lim 

i— >oo 



logvr(i) 



log 



1 — p 

P 
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1.3.2 Degenerate to the case of (2, 1) state-independent RW 



We consider the classical state-independent (2, 1)-RW on the positive line, for which the transi- 
tion matrix is given by 



P 



( 1 

qi + ?2 o p 

q 2 qi p 

<?2 qi o 



p 



\ 



where q\ + q 2 +p = 1, and q±, q 2 > and < p < 1. In this case, the recurrence criterion and all 
quantities in (|2.2p . f)2.4f) and (|2.ip can be calculated directly from our results as follows, which 
lead to a calculation of the stationary distribution. 

Corollary 1.4. 

k = oo (ft + 2q 2 > p. 
Corollary 1.5. If q\ + 2q 2 > p, then the walk {X n } n >o is positive recurrence, and 



P i+1 [(i + l,+oo),i-l] 



A - gi - q 2 
2p ' 



2A 



1 — p — pqi + 3pq 2 + (1 - 3p) A ' 



E % +1 = 1 | 1 ^f(l-Ai- 1 )(A 2 + 2) _ Aj(l-Ar 1 )(A 1 + 2) N ) + ^ - A* +1 



Ai — A2 ^ 1 — Ai 1 — A2 ' Ai — A 



where A = y (gi + g 2 ) 2 + 4pg2> Ai anrf A 2 are f/ie eigenvalues of 

Cqi 3i \ 
V P 
1 + 21 22 I • 
p p / 

Remark As a consequence, we can get 7r(i) = C( j^-)*, where C is determined by the transition 
probabilities, and Am = max{|Ai|, | A2 1 } - 



1.3.3 State-dependent queue with bulk service and impatient customers 

This is a special case of the (L, 1)-RW, in which p(k) > is deceasing (arriving customers 
with impatience since the probability p(k) for a customer to join the system is deceasing as the 
number of customers in the system increases); and the server can simultaneously serve multiple 
customers up to size L (bulk service). Assume p(k) \ p and qj(k) — > qj for j = 1,2, ... ,L. 
Then, according to Theorem 11.31 if ^ . jqj > p, then the stationary probability distribution ir^ 
exists and its tail decays geometrically with rate I/Am- 

We arrange the remainder of this paper as follows. As the main tool, the intrinsic branching 
structure within the (L, 1)-RW will be briefly reviewed in Section [2] for L = 2; and then the 
proofs of the theorems and corollaries will be detailed in Section [3] except Theorem 11.31 which 
will be proved in Section [4] for a general L. 
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2 A brief review for the intrinsic branching structure 



The intrinsic branching structure within a random walk has been studied by many authors. 
For the (1, 1)-RW, Dwass ([1], 1975) and Kesten et al. ([TO], 1975) observed a Galton- Watson 
process with the geometric offspring distribution hidden in the nearest random walk. The 
branching structure is a powerful tool in the study of random walks in a random environment 
(RWRE, for short). In [TO], Kesten et al, proved a stable law for the nearest RWRE by using 
this branching structure. The key point is that the hitting time Tj can be calculated accurately 
by the branching structure. 

However, if the random walk is allowed to have jumps, even to a bounded range, referred to 
as the (L, i?)-RW, the situation will become much more complicated. 

For the (L, 1)-RW, when the walk starts at and lim supn^^ X n = oo, a multi-type 
branching process has been revealed by Hong et aZ.([5], 2009). for calculating the hitting time 
Ti = inf{n > 0,X n > 0}. A similar work has been done for the (1, J R)-RW ([6], 2010). It 
must be emphasized that these two branching structures are not symmetric, instead they are 
essentially different. 

For the purpose of calculating the stationary distribution in this paper, both structures will 
be used. More specifically, for calculating E l Ti for i > 0, if the first step is down (possible at i — 1 
or % — 2 when L = 2), the branching structure within the (L, 1)-RW is used, and alternatively 
if the first step is up (to state i + 1), the branching structure within the (l,iZ)-RW is used. 
Here we call them the "lower" and the "upper" branching structures respectively, which we will 
briefly introduce below. Note that if we assume (72(2) = 0, both branching structures degenerate 
to the case of the (1, 1)-RW. 

2.1 The "lower" branching structure 

The following discussion is based on L = 2. The general case can be similarly discussed, which 
is much more complicated. Assume that Xq = i, if the first step is down (possible at i — 1 or 
i — 2) we can calculate E l Ti by using the branching structure within the (L, 1)-RW ([5], 2009). 
Define 

Ul = #{0 < j < T i+1 : = 1, Xj = 0} and U$ = 0; 

and 

\j[ = #{0 <j< T i+1 : X,_i > k,Xj = k - I + 1} for 1 < k < % + 1, I = 1, 2. 

Setting 

U k = (Ul,Ul) for < k < i + 1. 
We then have the following property. 

Theorem A (Hong and Wang [5]) (1) The process {Uk}\ = i is a 2-type branching process whose 
branching mechanism is given by: 

P(U Q = (a,0)|l7i = ei) = (gi(l) + <fc(l))°p(l), 
P(U = (1 + a,0)\U! = e 2 ) = (gi(l) + g 2 (l)>(l); 

and for k > 1, 

P(U k ^ = (a,b)\U k = e x ) = ^^-qi(krq 2 (k) b p(k), 
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P(U k -! = (l + a,b)\U k = e 2 ) = ^±^ qi {k) a q 2 {k) b p{k). 

(2) For the process {Uk} k=i , let M k be the 2x2 mean matrix whose l-th row is E{Uk~i\Uk = 
e{). Then, one has that 

( gi(i)+g 2 (i) n \ / £iM 92W \ 

f3j P°Ti = 1, and /or i > 0, T m = 1 + £1=0 £4 ■ (2, 1)' and 

i i 

E% +1 =l + Y J EU k - (2, 1)' = 1 + eiMM-i ■ ■ ■ M^ k+1 (2, 1)'. (2.1) 

k=0 k=l 

Remark i) The positions of the walk correspond to the time of the branching process. For 
example, in our notation, U k is indeed the (i — k)-th generation of the branching process. 

ii) The condition lim sup^^^ X n = +00 in [5] is obviously satisfied in our reflecting model. 

iii) It is not difficult to understand that the branching structure from U\ to Uq is different 
from others because of reflecting. We omit the proof here. 

2.2 The "upper" branching structure 

Assume that Xq = i, i > 0. If the first step is up (at i + 1), we can calculate E i+1 Ti by using 
the branching structure within (l,i?)-RW ([6], 2010). If the (2, l)-reflecting random walk is 
recurrent, Tfc, k > i, is defined the same as in Section 1. Note that r k < 00 P-a.s. To calculate Tj 
accurately, Hong and Zhang ([6], 2010) defined a multi-type branching process by decomposing 
the path of the walk. Intuitively, if the walk from k > i takes a step to k + 1, it must across back 
to k or jump over k (to k — 1) because of r k < 00 P-a.s., in which there are only three ways of 
moving down: from k + 1 to k, from k + 2 to k and from k + 1 to k — 1. So we divide all the steps 
from k to k + 1 into three kinds of steps according to the above three ways of moving down. Let 
A(k), B(k) and C(k) be the numbers of steps from k to k + 1 before time Tj corresponding to 
moving from k + 1 to k, from k + 2 to k and from k + 1 to k — 1, respectively. As for the last 
step of Tj, we can consider it as a immigration for the multi-type branching processes. 
Consider integers n > i > 1, and define the exit probabilities: 

P l [(i, n), i — 1] = P*{X n leaving {i, i + 1, . . . , n — 1, n} at the point i — 1}, 
P l [(i, n), i — 2] = P l {X n leaving {i, i + 1, . . . , n — 1, n} at the point i — 2}. 

In Hong and Zhang [6] (see Lemma 2.1), it has been calculated that (see also [T]) 

{e 1 ,[M i + --- + M n ---M i ]v) 



P l [(i,n),i-1] 



l + {e l ,[M i + --- + M n ---M i ]e l ) 



I*[(i,n),i- 2] = (eu[Mi_+--- + M n ---M i ]e 2 ) 

l + {e 1 ,[M i + ---+M n ---M i ]e i y 

f qi(i)+q2(i) q2(i) \ 
pW pW j , i > 1. 
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If k = oo, let 



7 (i)=p(i)-P ,+i [(i + l,+oo),i-l], 
a(i) =p(i) -P i+1 [(i + l,+oo),i] 

P(i)=p(i)-P i+1 [(i + l,+oo),i] 



«i(* + l) 



gi(i + l)+7(i + l) 
7(* + l) 



(2.3) 



5i(i + l)+7(i + l)" 
Set for k> i, 

V(k) = [A(k),B(k),C(k)}. 
Then we have the following branching structure within the (2, 1)-RW. 
Theorem B ( Hong and Zhang [6]) Assume k = oo. Then, 

(1) (v(k) = [A(k), B(k),C(k)]j is an inhomogeneous multi-type branching process with 
immigration 



V(i- 


1) = 


[1,0,0] 


V(i- 


1) = 


[0,1,0] 


V{i- 


1) = 


[0,0, 1] 



Qi («) 


1 — a(i) — 


0(0' 


7(i) 




1 — a(i) — 




Q2{k) 




1 — a(i) - 


pa) 



The offspring distribution is given by 

P(v(k) = [a,b,0] | V(k + 1) = [1,0,0]) = [1 - a(fc) - /3(fc)]<7£ +6 a(fc) a /3(fc) 6 , 

p(v(k) = [a, 6, 1] | V(k + 1) = [0, 1,0]) = [1 - a(k) - H(k)]C a a+h a(k) a f3(k)\ 

P{y(k) = [a,b,0] | V{k + l) = [0,0,1]) =[l-Q(fc)-^)]CXfc)«^(^, 

where a(k), (3(k) and j(i) are defined in \2.2\) . 

(2) The offspring mean matrix of the {k — i + l)-st generation of the multi-type branching 
process is 



N, 



l-a(fc)-/3(fe) l-a(fc)-/3(fc) U » 
l-a(fc)-/3(fc) l-a(fc)-/3(A:) x 
\ l-a(fc)-/3(fc) l-a(k)-0(k) u / 



f3j r, = 1 + Er=, [2A(i) + 2i?(,) + C(i)} = 1 + <(2, 2, 1), F«>, and 



£^ = 1 + ((2,2,1), 



1 



1 - a{i) - 



7(»), fcW) •X) JV i ,,,JV * 



(2.4) 



Remark i) In [6], Hong and Zhang considered the branching structure within the (1, 2)-RW on 
the line starting at before the ladder time inf{/c > 0,X& > 0}. It corresponds to the "upper" 
part of our model. 

ii) E t\ < oo is the sufficient condition of k = oo. 
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3 Proofs 



Proof of Theorem 1.1 According to Fact 1, we can prove the result by two different methods. 
Here we prove it through calculating E°N(0) directly by using the branching structure; and in 
the appendix we provide an analytical proof by solving the system of infinite linear equations. 
Actually, we find the solution to the system of infinite linear equations also in terms of the 
observation of the branching structure. 

Recall iV(0) = Yln^i ^{x n =o} 1S the occupation time of position 0. Because the walk is 
reflected at with probability 1, the walk goes to +oo a.s. Note that the walk goes up skip 
freely. Therefore, we can decompose the whole trajectory of the walk as the combination of the 
pieces from position i to i + 1 for i = 0, 1, 2, . . ., i.e., {X n ,n > 0} = \JiZo{X n ,Ti < n < Tj+i}, 
where To = 0. So, to calculate N(0) the occupation time of position 0, we need only to calculate 
the occupation time of position in each piece {X n ,Ti < n < of the trajectory, in which 

a "lower" multi-type process with an immigration at position i is hidden (Theorem A). To this 
end, let 9\ = 1 and for i > 1, 

i = t{k:T i - 1 <k<T i ,X k = 0}; 



4 




Figure 1: Immigration structure for the branching process 

which is the population of the i-th generation of the multi-type branching process with a immi- 
gration at i. By Theorem A, we have 

E°0i = eiMj_iMj_ 2 • • • M\u, i > 1. 

From the decomposition we know that iV(0) := Yl^Li l{x„=o} = S£i ^i- A s a consequence 
we get 



E°N(0) = E°J2 6 i = J2 ei M i-i M i-2 ■ ■ ■ M x u :-- 



K. 



i=l 



i=l 



The proof is complete by Fact 1. 



□ 



Remark Let £n = 0, £i = 1 and £ n = Y17=i ^* ^ or n — ^» ^ ne occupation time at position 
before the walk hitting position n. If y n = E°£ n , we find that y n is a solution of the system of 
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infinite linear equations ^j=^o PijVj = Hi * — 0- See the appendix, in which an analytical version 
proof of the present theorem is provided. 

Proof of Theorem 1.2 In our model, X n is irreducible and note that E°Tq = 1 + E t\, where the 
explicit expression of E l Tt is given in (|2.4p . So E^n < oo assures that the walk X n is positive 
recurrent by Fact 2 and has the stationary distribution 7r with ir(i) = -gr^r- To calculate E i Ti, 
we consider the first step of the walk starting at Xq = i. There are four possible types of the 
trajectory of the walk from position i back to position i as shown in the following graph. 




Figure 2:Four types of trajectories from i to i 

By the Markov property one can get, for i > 0, 

E% = V {i)(E i+l Ti + 1) + q 1 (i)(E i - 1 T i + 1) + q 2 (i)(E i - 2 T i + 1) 

= p(i)(^ +1 T i + 1) + q 1 (i)(Bf- 1 T i + 1) + q 2 (i)(E i - 2 T i _ 1 + E^T, + 1) 

= p(i)E i+1 T i + (q l (i) + q 2 (i))E i - 1 T i + q 2 (i)E l - 2 T l _ l + l, (3.1) 

and E°T = E X T Q + 1. 

We now calculate E %Jrl Ti. For the walk starting at i + 1, there are only two kinds of ways to 
hit i for the first time: from i + 1 or i + 2 to i with probability P l+1 [(i + 1, +oo), i]; or first from 
i + 1 to i — 1, then from i — 1 to i with the probability P l+l [{i + 1, +oo), i — 1]. Consequently, 

E i+1 Ti = P i+1 [(i + 1, +oo), i}E i+1 r i+1 + P i+1 [(i + l,+oo),i - l](E i+1 Ti+1 + E i_1 Tj) 
= E l+1 r i+1 + + 1, +oo), i - IjE^Ti. 

By (|3l]), we get 



^Ti = Pi E i+1 T i+1 + ( 9l (t) + + + 1, +oo), i - l)]^" 1 ^ + q 2 (i)E l - 2 T i _ 1 + 1 



31+ 1 



□ 



Proof of Corollary \1.1\ In this case, we have for i > 1, Mj := 



9(0 Q 

n I . Therefore, 







eiMfcM^! . . . Mm = 0) 



fe=i 



fc=i 



Qklk-l-'-Qi 

PkPk-l-Pi 
qk-lQk-2—Qi 

PkPk-l-Pi 
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We also have = 1. As a result, n = oo 4=> Y\^ n = 00. □ 
M0P0 ' U 

Proof of Corollary \TB By ||22|> . Q, fl23& and (|21j> . one can get 

F y _ 1 . p(Q , g(iM? ± 1) + ,• > 1 

1 g(;)%(^ + l)%(^(i + l)g(; + 2) + ' " ' 

E% 1 = — + + gi? ~ + . . . + g(l)g(2)---gW ■ > 

p(i — l)p(i) p(i — 2)p(i — l)p(i) p(0)p(l) . . . p(i) ' 

So /i = E 1 n, and fi < 00 <^=^ E^ti < 00. By Theorem 1.2, 

= 1 = Mi 



□ 



Proof of Corollary \l-4\ We define 



I J :=A M i= f 1+ % * :=S, i>l 



Let Ai t 2 = 9l+g2± "V^ g 2 ^ +g2 ) + 4 Pgi eigenvalues of Mj, i > l,and let Ai,2 be the eigenvalues 

of Mi. We can see that Ai = Ai + A2 and A2 = 0. Then, we can decompose Mj as 

M > = c '(o a°K' m < = d (o a°)' d " j>1 

Then, if Ai 7^ 1 

n 

eiM fc M fc _i . . . Mm = ei {E + B + B 2 ... B n )Au 

k=i 

= ^- d -(t 4)' d " c ( Al » A2 »)' c " ■ (m) ' 

^ 1 — Ai , 9 1 — A9 . o\ 



Ai — A2 v 1 — Ai 1 — A5 



if Ai = 1 



n 1 / 1 — \ n 

y^e l M k M k _ l ...M 1 u= -(A?n-- 

f— ' Ai - A2 V 1 — A2 

It is easy to see that A 2 = ^^^1+92)^92 £ ^ Q j_ Wg ggt ^ as n 00. 
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Hence, Y1T=1 e i^k^'h-i ■ ■ ■ M±u = oo 43- Ai > 1. By some calculation, 

Ai > 1 qi + 2q 2 > p. 



□ 



Proof of Corollary \1.5\ Define A, B, C, D, Ai and A2 the same as before. P i+1 [(i + 1, +00), i - 1] 
and E l Ti are calculated in [6], we need only to calculate E % Ti + \. By Theorem A, we get 

E l T l+1 = l + e 1 M i (2,l) , + elM ^ M ^ _ 1 (2,l) , + ... + elM ^ M ^ _ 1 ...M 1 (2,l) , 
= 1 + ex(B + B 2 + . . . + B l ~ 1 )(2, 1)' + e 1 ( J B i „ 1 ^)(2, 1)' 

l + ei-^-l ~ ±T ^~ 1-ri _Vi, I ■ I?" 1 - (2, 1)' 



A 2 (i-Ar l ) 
i-a 2 



+ei • D • 



AJ 



,»,). d -'. c .( a '^ ;)-( Ai ; A2 s)-c-'.(2,iy 

: + 1 ( Af(l-A;-')(A 2 + 2) _ Al(l-A'- 1 )(A 1 + 2) ) + ^ - A| +1 
Ai — A2 1 — Ai 1 — A2 Ai — A2 



□ 



4 Tail asymptotic of ir(i) — proof of Theorem 11.31 

It is well known that when the random walk is state-independent the tail of the stationary 
distribution of the walk has a geometric decay. With the help of the explicit expression of 
the stationary distribution, we can consider the tail behavior in the state-dependent case. We 
note that the expression of the stationary distribution in Theorem 11.21 is given in terms of the 
decomposition of the trajectory with different parts. This enables us to find out that the key 
factor to determine the tail asymptotic behavior of 7r(i) is E l Ti + \ ( because of E t\ < 00). In 
this section, we consider the case with a general L (not only for L = 2), i.e., the (L, 1)-RW. 

Suppose L > 1, to express E l Ti + \ we need only the "lower" branching structure hidden in 
the random walk which we have introduced in Section 2. Recall for i > 0, 



E i T i+1 = l + Y J EU l 



k • w L 



k=0 



where e L = (1,0, ••• ,0), w L = (2, l,--- , 1) 
branching processes are given by: 



p(t) 



Mi 



92 (i) 

PW. 



1 + 



p(i) p(i) 



9i W 
p(i) 

9iQ) 
V 



\ 91 W 92 W 

\ p(i) p{i) 



92 (t) 
p(i) 
92 W 

W) 



1 + ^2 a M i M i-i ■ ■ ■ Mi_ k+1 w' L , 

k=l 



The offspring mean matrices of the multi-type 



9l-iW 

p(i) 
QL-iW 

p{i) 

9l-iW 
p(i) 

91,-1 W 
P(i) 



1 + 



p(i) 
p(i) 



9l(») 
p(p 

w / 



LxL 
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with a little attention to the reflect effect we notice the difference for 1 < i < L, 



l 



M L - 



glCO 92 (i) 

PW p(i) 

PW pW 



PW 

giw 

PW 



ga(») 
P(i) 
ggW 
P(0 



91,-1 

pK 

g_L zl lW+g£ W 

pt*l 



9Z,-l(»)+9l,(») 



1 + 



pT*1 



\ 



0/ 



LxL 



and 



— l-g^w 



Mi 



1 + 



TUT 



91 W_- 



PW~ 
■■+9lW 



V 



PW 

9i(»)H I-9l('0 

p(i) 












\ 









LxL 



The following two propositions about matrix analysis are needed for our proof. Recall, for a 
matrix A, p(A) is the spectral radius of A, and Xa is the maximum eigenvalue of it. 

Proposition 4.1. (Perron's Theorem, f^) If A = (aij)LxL £ ~R LxL . and A > 0(which means 
> 0,aij > 0), then 

(a) p(A) > 0; 

(b) p{A) is an eigenvalue of A, and it is the unique eigenvalue of maximum modulus; 

(c) p(A) is an algebraically (and hence geometrically) simple value of A; 

(d) [p(A)- 1 A] k -)• R as k ->■ oo ; where R £ R LxL , and R>0. □ 



A measure for the distance between the spectra o~(A) = {Ai, A 2 , 
is defined below, which is the optimal matching distance: 



A L } and a(B) = {m,n 2 ,. 



d(a(A),a(B)) = min max |A; 

9eS L ie{i,2,-L} 1 



where Sl denotes the group of all permutations of the numbers 1, 2, • • • L 
Proposition 4.2. f/77] / ./7^ / ) 

d(a(A),a(B)) < 4(2it) 1_ «||,4 - B\\n 

where K = max{||A||, ||l?||}. 

This result says that there exists a permutation such that the maximum of the distance 
between the corresponding eigenvalues is small enough. 

Let D := {(p, q x , q 2 , ■ ■ ■ q L ) : p + Ej=i <?i = U Y!j=\3 a 3 > V J' % ^ °>P > °i- A 
point P = (p, qi, q 2 , • • • qi) in D corresponds a state-independent transition probability of the 
(L, 1)-RW, and the offspring mean matrix of the correspond multi-type process is denoted as M 
(it is independent of the position i). 
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Lemma 4.1. If P £ D, the offspring mean matrix of the lower branching process M = (mij)LxL 
has the unique eigenvalue of maximum modulus. That is 

p(M) > 1, 

andp{M) = X\i- Let C = A{- + 2L) 1 ~ l Ll . For e < min{^rr(AM — 1) L , minmy}, we have 



X £ M ■= p (M - eE) > X M - CeT > 1, 1< \ £ + ■= p(M + eE) < \ M + CeT, 



where E = (1,1,- ■■ 1)' • (1, 1, • • • 1). 
Proof First, to prove p(M) > 1, let M 



( A-l 




\XI-M\ 





A- 21 
p 



\ 








.21 
v 



21 
P 



-(! 




M 


)■ 


by 










\ 


QL-1 








V 




P 




QL-1 




_£L 




p 

QL-1 

P 


A 


P 

_ £L 
P 


/ 



by some calculations, we get 



Define f(x) 
then, 



x L+i _ l x L-i . 





/ A-i 

p 


21 

p 


qL-i 
p 


- \ 

p 




-1 


A . 













• 


• A 







x 


• 


■ -1 


A ) 


e |A/ 


-M\ = 


f(x). Let F(x) 


= /(i 



5lx L+1 + qL-ix L H h <?i£ 2 - x + p. 



Note that P G Z), it is easy to see that -F(cc) = has a unique real root in (0, 1). As a consequence 
\\I — M\ =0 has only one real root larger than 1, so the largest eigenvalue of M is larger than 
one. One can see that 1 is not an eigenvalue of M, and the set of eigenvalues of M is the union 
of the set of eigenvalues of M and {1}. So we get p(M) > 1. By Proposition 4.1, p(M) = Am 
is obvious. 

Next, for A £ lR I ' xi , define || • || to be the maximum column sum matrix norm, that is: 
\\A\\ = max^^^ \ctij\- Choose an e such that both M — eE and M + eE are positive matrices. 

By Proposition 4.1, both AT7 and ATt are meaningful. By Proposition 4.2, we have 



- 2 U- 



ill 



d(a(M),a(M - eE)) < 4(-) 1 -rLreX < Cel, 

P 

2 ill i 

d(<r(Af),<r(M + < 4(- + 2L) 1_ i:Liei < CeL. 

P 

For such e, it is obvious that Xm — CeL > 1. If X £ A f < Xm — CeT, for Am, then there exists 
no permutation such that d(a(M),a(M — eE)) < CeT, because X 6 ^ is the largest eigenvalue of 
M -eE. 

On the other hand, because M + eE > M > 0, we have p(M + eE) > p(M) > 1 ([7], 
P491, Corollary 8.1.19). If A^ > Am + Ce'E, then there exists no permutation such that 
d(a(M),a(M + eE)) < CeL ; because Am is the largest eigenvalue of M. □ 

Proof of Theorem 1.3 The first part of the Theorem 1.3 has been proved in Lemma 4.1. Now 
we focus on the second part. 
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Step 1 To prove Hindoo logg fc rfc+1 = log Am . Let 

i 

= Yl e L M i M i~l ■ ■ ■ Mi- j+ iw' L , 



i 

<p(i) = J^AfiM i _ 1 ...M i _j + i. 

j'=i 

By formula ([23]) . ^T i+ i = 1 + 

Because -P(i) — > P, we have Mj — > M. By Lemma 4.1, Am > 1. For each e we defined in 
Lemma 4.1. 3N, when n > N, 

< M — eE < M n <M + eE. 

Then we have 

< (M - eE) 2 < M N+2 M N+ i < (M + eE) 2 , 



< (M - eEf < M N+k M N+k _ x • • • M N+1 < (M + eE) k . 
Summarizing these formulas leads to: 

(M - eE) k + (M — eS)^" 1 H h (M — eE) 

< Miv+fcMjv+fe-i • • • Mtv+i + M^v+fc-i • • • M N+1 + ■■■ + M N+1 

< (M + eE) k + {M + eE) k ~ l + • • • + (M + eE). 

For the given N, Let Ajv = M N M N _ X ■ ■ ■ Mi + M N _ X ■■■M 1 -\ \-M 1} B N = M N M N _ X ■■■Mi. 

Then 

(M - eE) k B N + (M — eEf^Bx H + (M — e^Bjv + Ajv 

< ^(A^ + fc) < (M + eE) k B N + (M + eE) k ~ l B N + • • • + (M + e£)Bjv + Ajv- (4.1) 
Now we first consider the "<" part of the result. From (|4.1|) . we have 

(^(iV + fc) > {M-eE) k B N . 

Then 



*(JV + A;) > (A^) fc e L VJ " c 7 iW, 



(M - eE) k 



(M - eE) k 

I -|- K)) ^ K log, A M i- lOg, tL 

By Proposition 4-1, as A; — >• oo, 



log($(JV + k))>k log A^ + log e L K ' B N w L . (4.2) 



(M - eE) 
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as a consequence eL ^.e-fu ^N W L is bounded in k. Thus from (|4.2p as k — > oo 



log<3?(£;) 

k— >oo 



Um jfc - bg A ^ " 



Note that from Lemma 4.1, X e M > Xm — Cel > 1. So 

lim lQg ^ (A:) > log(A M - Ce£). (4.3) 

For the right "<" part, define i/>(A;) = e_L B^wl- From (14. lj) . we have 

HN + k) < (\lt) k (4>(k) + i>{k - 1) + • • • + V(l) + A N ), 

log $(iV + k) < k log(A^) + log(V>(fc) + ^(fc - 1) + ■ ■ • + ^(1) + Ajy). 

It's easy to see that lo gW fc )+^( fc +^(1)+^) _^ q ag ^ _^ ^ (because lim^oo i/j(k) exists). 
Therefore, 



- — loe<J>(A;) 



By Lemma 4.1, 1 < Aft < Am + Cei . So 



l im lo g3(*0 < log(A M + CeT). (4.4) 
Combine (|4.3|) and f)4.4[) to have 

log(A M - C £ r) < hm < Ihn" < log(A M + Cet). 

Let e -> 0, we get ( recall E% +1 = 1 + $(z)) 

lim log^ =lim log|W =logAM 

fc— >oo fe fc— S-OO fe 

S'iep ,2 It's easy to see that when P(i) —> P and P £ D, the walk is positive recurrence. So 
the stationary distribution exists and ir(i) = jSf:- By the same method we have used in the 
proof of Theorem 1.2, we get 

L-l 

E% = p(i)E i+1 r i+1 + fiitf-tTi-i+i + q L (i)E i - L T i - L+1 + 1 (4.6) 

i=i 

where = Y^=i1k{i) + p(i) Y^j=i -P l+1 [(* + 1, +oo),i — j]. Because the walk is positive re- 
currence, E l+1 T{ + i < E n < oo; on the other hand, under our condition, < p(i) < 1, 
< qi{i) < 1, < -&i < L + 1. Then tells us that E^T, is the dominated term for E%. 
By 63}, 

logTr(fc) logg fc T fc log^- 1 ^ 
lim = — hm = — lim = — log Am . 

fc— >oo k k— s-oo k k— ¥oo k 
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□ 



Appendix: Analytical proof of Theorem 1.1. 

Let £o = 0> £1 = 1) an d £n = X^r=i @i f° r n — 1> the occupation time at position before the 
walk hitting position n. By Theorem A, we have 

E°9i = eiMi_iMj_ 2 • • • Miu, i > 1. 

For the system of equations Y^jLo ^ijVj = Vi> * — ^' we wm P rove y« = -E^n is the solution, the 
probabilistic meaning of which is the expectation of the visiting time at position before the 
walk hitting the position n. The system of equations can be rewritten as, 

m =p(i)y2 + 912/0, 

y 2 = p(2)y 3 + ?i(2)j/i + q 2 (2)y , 



y n = p(n)y n+ i + 9i(n)y n _i + q 2 (n)y n - 2 , 



It is not hard to show that the solution spans a two dimensional linear space. We can prescribe 
yo and y\ arbitrarily for the initial values, and then all the other are determined by these 
equations. Trivially y\ = 1 is a solution. We show that If y n = E°£ n , for n > is also a solution 
now. 

Setting xo = 0, x\ = 1, and for n > 2, x n = y n — y„,_i, we obtain: 

,<&(!) ,<fc(lh 

Pl(l) Pl(l) 

92 (2) (2) ,9 2 (2), 

P2(2) P2(2) P2(2) 



_ 92 W , , gi (») , g2(") A 

p 2 (n) p 2 (n) p 2 (n) 



We just need to prove that x n = E°9 n is the correspond solution. In probabilistic meaning, x n 
is the expectation of the visiting time at position in the n-th immigration structure. For the 
first equation, 

Pi(l) pi(l) pi(l) pi(l) 
For the n-th equation, let £T n = M n _ 2 M n _ 3 • • • Mm, 6 n (l) = ^,b n (2) = 3^. 
E°9 n+ i = e x M n M n ^K n 



17 



MlK-i(l) + 6 n (2)&n-i(2) + b n (2), 6 n (l)6 n _ 1 (2) + 6 n (2)6 n „ 1 (2)jK n . 
On the other hand, 

p 2 [n) P2{n) P2\n) 

= (6 n (2)ei + (6 n (l) + 6 n (l))e 1 M n _ 1 )^ n 
= ((6„.(2),0) + (6 n (l) + & n (2),0)M n _ 1 ) J Sf n 

= ((M2), 0) + + ^(2),0)( 1 ^ 1 | 1) 

(2) j (l)6 n _i(2) + 6 n (2)6 n _ 1 (2))K n , 



which means that x n = E°6 n is the correspond solution of the equations above. So y n = E £ n 
is the solution of Yl'jLo PijVj = — 0- It is evidence that y n = 1 are another solutions of the 
system. Therefore, the general solution is given by 

(y , y lt . . . ,y n . . .) = a • (1, 1, . . . , 1, . . .)' + p ■ (£%, • • • , E°£ n . . .)', 

where a,/3, S R, and a nonconstant bounded solution exists if and only if E°^ n is bounded, i.e., 
££Li eiMfcMfc.x • • • Mm < oo □ 

Remark The probability meaning of 0j, i > 0, is the expectation of the local time at zero of 
the walk starting at % — 1 before Tj, which is the motivation of the proof. 
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